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hat are the uuplications of digital maging 

for the evolution of cinematic language? Since 1986, Peter 
Weibel, Steina and Woody Vasulka and I have been meeting 
to discuss that question [1]. We thought our talks might be- 
come a book, whose subject Weibel conceived as “the evo 
lution of the image through the digital image”. What follows 
isan outline of our conversations, assembied tor this publi- 
calion from 200 pages of transetint Trisin every sense a first 
draft, a working paper. We are quite aware of the protlem- 
atic nature of our discourse, cspeaiaiy in the cursory form 
presented here. Every conclusion is vulnerable to criticise), 
which we welcome. We are certain vi only one thing. that 
these questions are important and need to be explored 

The subject of ‘digital imagmg’, we agrec, exists in the 
context of both video and ihe computer (different only in 
the source of the image and the possibility of real ume 
operation) and covers the generic areas of image pro- 
cessing, image synthesis, and writing or organizing digital 
code in a procedural or tinguistic fashion £2). Bue in evcry 
case when we refer to the pienamenaisee of the mioving 
image, we call it cinema Por us itis important to separate 
cinema from ils medium, juscas we separate music fe 
cular instruments. Ginesoa isthe art of Organiving ale in 
of audiovisual eventsin ice cadisap centsireann, like inusic 
{3}. There are at least dour media Urrough which we can 
practice cinema--film, videu, hologeraphy and structured 
digital code—just as there are many instruments through 
which we can praciice music. OF Course each tnediuime has 
distinct properties and contributes differe tly to the theon 
of cinema, each expands our knowledge © 6 het cmeina can 
be and do, Fach new medium modifies wid stends the lin- 
guistic possibilities of the moving mage. subsaiing the syiv 
taxes of previous media without negating ther 

Thus, the basic phen ncenclogy of the moving inuage— 
what Vasulka calls “the pecformance of tie image on the snr- 
face of the screen"—remains historically continuous across 
all media. Digital code, for exampir, has radically altered 
the epistemology and ontology of the nioving image but har 
not fundamentally changed its phenumenology There ve 
no digital images that have not been prefigured it: paints 
film: and video, With the code we can only summarize thect. 
elaborate and unfold them or exercise inocebtics Viasat. 
calls the code a variation machine. There ate no nes. Classes 
of images, there are only new varialions aud new episic no- 
logical and ontological conditions for generating anc wit 
nessing those variations, Each new medium of the future, 
says Vasulka, can only “play host to the phenomenology of 
the moving image”, which will evolve through that medium 
to the next, av 7 amulating he heel dens of ae | 
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Warboo outs iothis wav aang 
iin as “a Corpus, Of arsttct 
strategies” minerited from pre- 
Vious media. In the 1320s math- 
emaucians atlacked the prob 
leis of foundations Whai was 
pure logic? What was an axon 
Today the ariswers te 9 ose 
questions are impleme: in 
the computer, Logiecl con: 
cepts have become insuumen- 
tal, they have become parts of 
machines. And any machine 
elen at, Sys Veeebot Ss aiath: 
toy hura phys al uapieror 
tion of a formal device. ft im- 
plements mental strategies into 
something physical. (This ts 
what Buckminster Fuller meant 
when he defined technalop as 

nsicmmBenicd or doce ap 
nvedlect’). Similarly, aesthetic 
Straicgies inveimced TOG years 
age in photography and 
cinema—scaling fit Tore UVe, povuve epee PONT sad 
WIPES, Matles-“Have NOW BECOn GC Wee Ce GES WE 
operations are Uiviallv invoked is Oh Gte preset re uites 
Ivas a quespon of pnim.uves. The code ls a nie iamedition 
through it, high-level aestheite consiructs from: previous 
media become the primes of the new mediom. Phry 
influcnces which aesthetic strategies wii ve cmp hasived 
When a strategy that was possible bat dafficu'! ir film be. 
comes a preset bution i video or a Command ta comnpiiie! 
graphics, it tends to be used more frequendy, Bot that does 
noi make mmore meauingfal, The chatlenee ps ca caer fet 
fecls HHO CA DIessfons, ENLO SYNLAG HE OP On On cans 

This raises the quesQon, Have bas the Corpus af a7 
strategics inberited in a medium bke photog uh ar tie, 
transicied over to electronic medut and espectsdiy tet 
code? Thicigs are possible in the ¢ode that were ies possiate 
or at least not easy, in film and video. Only by coumnparingt 
‘ormal devices developed in one nicditum te other devices + 
acvetoped in ucher media cat we ois tve at criteria for evat- 
to artistic achievement Heve die yntactical and linguis- 
WC possibilities or the digital image been identified and 

Heer dtlec ie practice? We think not—at Icast, not vn 
Often We rarely tind them in the work thatis otherwise ad 
mired in the name of the mediuiu. Peopie praise a particu: 
lar work of ‘video’ or of ‘computer art’, and yet we find in 
this work no definitory elements of video or of the code: It 
may be great cinema but it is not great elecirontc cinema. We 
are not arguing for exclusivity or essence. We are not trying 
to os the Clement wpa of thescode. The phenome- 
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fundamental challenge to the meto- 
nymic nature of cinematic language. 
He invokes the name of Roman Jakob- 
son, who argues that there are only two 
fundamental operations in language: 


metaphor and metonymy. And the 


language of cinema is not metaphoric, 
it is mctonymic. It is the language of 
the part for the whole. All cinematic 
images are contingent. The frame, 
said Jakobson, is always part of an un- 
scen whole. At its fundamental syn- 
tactic levele-the level of cutting, of 
editing, of bringing spaces together— 
the filmic language game is meto- 
nynuc. In the service of psychological 
realism, conventional editing recon- 
structs ‘real’ time and ‘real’ space, fol- 
lowing logical causa! chains by me- 
tonyimc association. Experiments like 
Last Yea at Manerhad were alempe s to 
transcend that limitation within psy- 
chological narrative. But in the elec- 
tronic image there is no need to make 
a Marienbad, because itis clear that we 
no longer have that constancy of time 
and space. Once an image-object iv set 
against a reference, the metonymic 
tension is lost. Objectifying the image 
within the frame puts it ina different 
lime zone. Metonymy becomes prob- 
lematic. On the one hand, suck con- 
structs are nol mectonvmic because the 
space they occupy is not ‘natural’, The 
image-object is not part of the whole; 
it isno Jonge: contingent, But it is not 
metaphoric euher. It is something 
new. We do not know what it is. It 
might still function metonymically, 
but ina differcnt way. This isan imipor- 
tant area that is wide open for ‘aes- 
theuc exploration, 

The second level of the image as ob- 


jectis achieved through digital image 


synthesis, Here, because it is a three- 
dimensional database, we can control 
not only the location of the image- 
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object within the frame but also its 
perspective, its angle of view, its 
geometry, As a result, the synthesized 
image becomes truly an object, the wit- 
ness becomes a ‘user’, and the relation 
between them becomes not obser- 
vation but interaction. Jean-Louis 
Baudry argucs that, in the cinema of 
psychological realism, the primary 
identification of the spectator is not 
with the characters but with the cam- 
era itself (5). But in interactive image 
synthesis, the spectator #s the camera. 
Since it is not separate from the scene 
it surveys, the virtual camera is neither 
a voyeur nor an instrument of surveil- 
lance. “Itisa point of view that is active 
within the scene”, writes Catherine 
Richards, “Not only can thi camcra 
{the user) direct its own looking, itcan 
be sensed, responded to, and rep- 
resented in the scene: it sees and is 
secn” [6]. 

The third level of the objectifica- 
tion of the image is realized through 
three-dimensional display. Whether 
through holography or binocular 
(stereoptic) technojogy, cinema_ is 
moving from the two-dimensional 
image on a screen to the three-dimen- 
sional object in space. Today cinema 
represents reality; tomorrow it will be 
reality. Already with stereoptic tech- 
nology the image becomes an object. 
And in Scott Fisher’s virtual envi- 
ronment project of the U.S. National 
Acronautics and Space Admini- 
sation (NASA) (combining a three- 
dimensional database with stereo 
Vision in a wraparound head-mounted 
display), cinematic space becomes a 
place to live. An unframed image is 
not an image, Vasulka points out, it is 
an object in space: “It forces you to 
dea with air.” Jt is no longer a repre- 
sentauion but the thing itself. Vasulka 
notes that different understandings of 





reality and truth are implied by the 
representational image and by an 
object in space, no matter how insub- 
stantial that object ma be. Three- 
space cinema, he suggests, is more like 
theatre. In two-space crema there »: 
truth but no seality. In theatre there ts 
reality but no truth. 
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impossible to distinguish every voice 
in a musical coinposition. One is dis- 
turbed by this only if one is unfamiliar 
with it. Once one learns to read it, the 
dense text is a pleasure. Digital code 
offers possibilities of image-overlay 
whose linguistic potential we have not 
begun to explore, 

The second possibilty is more fa- 
miliar: framed parallel event-streams, 
such as split screens in film (optical 
printing) or floating imageplanes in 
video, done with digital effects devices 
such as ADO or Quante). But there is 
also the possibility of unframed parallel 
events occupying different areas of a 
single image. This can best be seen in 
the work of the Vasulkas, for example, 
where vointillist textures move inde- 
pendently in sepaiate areas of the 
frame. Different zones of the image 
are activated in different ways in 
parallel. The Vasulkas accomplish this 
through digital image processing. But 
image synthesis, through a variation 
on metamorphosis, would provide un- 
limited possibilities for unframed but 
separate parallel event-streams in a 
single frame. 

Below, ina discussion of the image 
as object, ! shall have more to say abuut 
paralicl event-sueams, Meanwhile, 
consider that simultaneity enlarges 
our concept ofa cinematic event, Wei 
bel puts it this way: whereas first we 
had the industry of the moving image, 
today we have che industry of the ac- 
celerated image. If there are three 
image-planes instead of one, the infor- 
mation conveyed within the overall 
frame is tripled, and, furthermore, 
each succeeding image destroys the 
meaning of the previous one. The in- 
formation is accelerated so much in 
perspective and in all other ways that 
the value of ‘the image’ is replaced by 
the value of the image-gestalt. or 
image-field. 


TTEMPORAL 
PERSPECTIVE 

“The history of every art form”, wrote 
Wahter Benjamin, “shows critical 


epochs in which a certain art form 
aspires to effects which could be fully 
obtained only with a changed téchni- 
cal standard, that is to say, in a new art 
form” [4]. Weibel pursues this logic in 
reverse, working backward from the 
digital image to find desire for its 
powers in art history. He begins by 
noting that Renaissance perspective 
was always at eye level with one paint 





of view and one vanishing point. By 
1850,. photographers were climbing 
onto Parisian rooftops and shooting 
down into streets. Twenty years later, 
QOdilon Redon painted a_balloon- 
suspended eye moving up into the 
sun. Perspective as no longer bound to 
a static point of view. hi had become 
free-floating. In the same periad, the 
German Romane painter Kaspat 
David Friedrich painted mountain 
shadows falling at an angle different 
(that is, displaced in time) from that 
uf the impinging sunlight. Other 
examples are found in the work of E] 
Lissitsky and the Cubo-Futurist move- 
inent. Painting, influenced by photog: 
raphy and cinema, mtroduced mulii- 
ple points of view and imphed une. 

And what did cinema do with per- 
spective? Not niuch. Bound to psycho- 
logical realism. it exploited it only spa- 
tially, mainly through deep focus 
(Eisenstein, Welles, Renoir), never 
temporally. Only in experimental cin- 
ema was temporal perspective e¢x- 
plored in any serious way at al.—the 
outstanding example being the work 
of Michael Snow, such as La Region 
Centrale and Back and Forth. But with 
the advent of the code, the emphasis 
on perspective returns. Moving-imaye 
art can now cinbrace iin an emphatic 
way. When the image is a three-dimen- 
sional database, perspective becomes 
a temporal as well as spatial phenom- 
enon. It is a strategy that is intrinsic to 
the code. Painters, photographers and 
fnmakers could not realize the full 
potential of this desire, But now we 
can unfold and elaborate that which 
could only be indicated in earher 
media, 

Vasulka notes that, ifwe remove the 
two cinematic vectors from earth to 


space and establish the principle of a 


point in space, we arrive al two possi- 
bilities: first, cinema looks from one 
point to infinity in a spherical point of 
view. That is one vector, we shall say. 
The other is the opposite: one looks 
from each point tn space towards a 
single point. Tf all Ghese points are in 
motion around one point, thal is che 
space in which idea} cinema operates. 
Butas long as we are talking about psys- 
chological realism we will be bound to 
an eye-level cinema. 


THE IMAGE AS OBJECT 


There are three technologies through 
which the image can become an 
object; image processing, image syn- 





thesis, and three-dimensional dis- — 


play—either binocular (stereopuc) or 
holographic. The code is responsible 
for the first two and may be partially 
involyed in the third. This is another 
aspect of parallel event-streains. We 
recugnize cinema as frame-bound 110 
frame-unbound. Mechanical cinenia 
is Characterized prumarhy by is 1cue 
ance on the irame. fecannot deare wie 
frame unless a special cilort 1s nade 
through optical pricing. But wr 
code it becomes a trivial mater to re- 
move the image from the frame and 
lreat it as an object, an image-plane, 
because those tools have ao capacity 
to deal wit): f.e geometry of the imiage 
itself: the; teal only with its locauen 
or position (its ‘address’) within the 
larger frame. Ihe use of framed paral- 
lel events points to new narrative pos 
sibilittes, new semiotic stralegies-——io) 
example, the possibility of a previous 
or future event appearing spatially be- 
hind or in front of a current eveni 
within the same frame. There is always 
a pending image. Editing can be 
avoided entirely—as Vasuika aid minis 
1987 work Art of Menury He points ov 
that, through doecracies of pina 
planes in particular arrangements oe: 
a mental space’, future and past tenses 
may be suggested. As already imei 
tioned in the discussion of paralici 
event-streams, convenuional film lan- 
guage is rather inarticulate in this re- 
spect. There is no temporal eloquence 
in film. But digital video suggests the 
possibility of establishing one unage- 
plane as ‘present’ with other Gime- 
frames visible stinulianeously within 
the frame. This would extend the pos: 
sibility of transfigurauoen Gmetamor 
phosis) into a narrauve space cone 
posed ot Jayers of Ome, cithicr as 
moving or sill images. Fd brishwa- 
ler’s Sunstone was one of the fits: works 
to explore ihese possipitities. In it the 


image becomes object, and ot has bow 


tramed and unframed paralici ovo: 
streams. a 
When image becomes object Mi a 


stream of parallel Evo as. be geal of 


psychological reabsat GF pbuto 
grapmic Uulh $8 ¢ amdencd. bie 
frame-bound = pnow ore se 
brings us tiuth. But chice image 
planes within a frame lose what Va- 
sulka calls “the aura of truth’. Ye 
detach ourselves from them psycho- 
logically. Will 11 be possible to con- 
struct a psychological space in’ a 
language of frame-unbound parallel 
event-streams? 

For Weibel, all this 
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nology of the moving image remains 
constant across all media, but cach 
new medium brings about a shift of 
emphasis or accent. Through the 
code, we can unfold the potential of 
formal strategies that were possible 
but limited in previous media, thereby 
expanding the richness of cinematic 
language. 
Vasulka asks, “Who creates the Jan- 
_ guage ofa medium?” Weibel] responds 
by quoting Heidegger: “Man is but a 
guest in the house of language.” Va- 
sulka agrees. All possibilities of a sys- 
- tem, he says, are contained within that 
system. We are not free to invent the 
language of film, video or computer. 
The language already exists in the sys- 
tem. Our task is to discover it, identify 
it, draw it out and name it, put a 
nomenclature on it. Vasulka has built 
his machines in order to discover ‘the 
language’ in them, which could be 
found only through dialogue with the 
machines. He points out that this is 
not unique to electronic cinema. Film 
language also arose from a similar sys- 
temic understanding. As a syntactic 
device, the cut, the edit, is machine- 
bound. Itis the only way to splice film. 
The most important figures in the his- 
tory of film are those who elaborated 
its syntactic or linguistic potential, 
This is our criterion for artistic 
achievement in the new medium: to 
what extent does the artist articulate 
and develop the formal possibilities of 
the system as syntactical or linguistic 
clements? To what extent docs the art- 
ist transform effects into expressions? 
It is a question not only of the evo- 
lution of cinematic language, but of 
human perception itself. Human 
vision, Weibel points out, has always 
been ‘machine-assisted’. The inven- 
tion of perspective, for example, was 
machine-dependent. It was derived 
from optical instruments. Ddrer’s 
boxes were in this sense ‘machines’. 
They implemented plivsically what 
then became formal strategies. With 
the help of this machine we could in- 
vent perspective. (Weibel chinks this 
curious. Why did it take so long?) Sim- 
ilarly, Vermeer, under the influence of 
Spinoza and the science of optics in 
the seventeenth century, created 
paintings that were not initially scen as 
poetic. They were regarded more as 
scientific research, (In the ninetcenth 
century, Proust, influenced by photog- 
raphy, ‘rediscovercd’ Vermeer, now 
regarded asa poct. The computer is to 
the artist of today as the Jens was to 
Vermeer.) The Impressionists, too, 


were following thcorics, not subjective 
experience. Impressionism was based 
on color theory: three different colors 
produce a fourth impression. An opti- 
cal theory of color, says Weibel, is also 
a machine, a mental machine, like a 
Turing machine. Thus we have sub- 
stantial evidence that the evolution of 
vision is dependent on machines, 
either mental or physical. It has come 
to the point that it is no longer pos- 
sible to suppress the machine part of 
it: first chere was the camera, now the 
computer. This is significant, Weibel 
thinks, because art always trics to sup- 
press the influence of the machine ele- 
ment in the work itself. It is not art if 
the technology is too apparent. But 
the issue here is not art, it is language 
and perception. They co-evolve only 
to the extent that the syntactic possi- 
bilities of technological systems are 
made the subject of aesthetic inquiry. 

The following formal possibilities of 
digital imaging are available for ar- 
ticulation as syntactic elements or 
linguistic primitives: (1) image trans- 
formation, (2) parallel eventstreams, 
(3) temporal perspective and (4) the 
image as object. 


IMAGE 
TRANSFORMATION 


If mechanical cinema is the art of 
transition, electronic cinema is the art 
of transformation. Film grammar is 
based on transitions between fully 
formed photographic objects called 
frames. It is done primarily through 
that collision of frames called the cut, 
but also through wipes and dissolves. 
Jn electronic cinema the frame is not 
an object but a time segment of a con- 
tinuous signal. This makes possible a 
syntax based on transformation, not 
transition. Analog image processing is 
one vehicle of this particular art—for 
example, scan prev sssors. But it be- 
comes even more significant in digital 
image synthesis, where the image is a 
database. One can begin to imagine a 
movie composed of thousands of 
scenes with no cuts, wipes or dissolves, 
each image metamorphosing into the 
next. 

Acutisa cut, but a transforming or 
metamorphosing operation is open- 
ended, There are infinite possibilities, 
each with unlimited emotional and 
psychological consequences. Meta- 
morphosis is not unique to digital im- 
aging; it is a familiar strategy in hand- 
drawn animation. What is unique is 






the special case of phoforeal metamor 
phosis. It is one thing for a line draw- 
ing or fantasy painting to meta- 
morphose, quite another for a 
photogtaphically ‘real’ object to do so. 
This is theoretically possible in me- 
chanical cinema and has been pre- 
figured (but never fully realized) in 
hand-drawn animation, where it is so 
difficult and time consuming that itis, 
for aj] practical purposes, impossible. 
It is possible digitally, because the 
code allows us to combine the subjec- 
tivity of painting, the objectivity of 
photography and the gravity-free mo- 
tion of hand-drawn animation. 

Steina points out that there are two 
kinds of transitions based on the cut, 
and these require different kinds of 
metamor phoses. One moves us to a 
different point of view in the same 
space/time, the other moves us to a 
different space and/or time. In flash- 
backs (cinematic memory), either a 
matte is used within the frame or the 
whole frame dissolves. With the code, 
a part of the frame can metamor- 
phose. This implies an expanded cine- 
matic language of simultancity. 


PARALLEL 
EVENT-STREAMS 


With the arrival of electronic cinema 
it became apparent that film grammar 
was limited in what might be called its 
vocabulary of tenses—for the most — 
part it was ‘meanwhile’ or ‘after’. For 
example, simultaneous events are 


traditionally signified through cross- 


cutting, or what is known as parallel 
montage. But, Weibel notes, there was 
never a formal distinction between a 
cut to a different position in space/ 
time (say, between people in conversa- 
tion) and a cut between different 
spaces or time, The distinction has al- 
ways been logical or inferential (as in 
parallel montage), never formal. Digi- 
tal code offers formal solutions to the 
‘tense’ limitations of mechanical cin- 
ema, Past, present and future can be 
spoken in the same frame at once. 
There are at Jeast three possibilities: 
superimpostion (overlay), or simulta- 
neous but spatially separate event- 
streams that are cither framed or un- 
framed. Superimposition has beca 
explored extensively in experimental 
film, notably by Stan Brakhage. His 
work is the closest cinema has come to 
the Joycean text. In such work itis not 
always possible to identify consciously 
each image-streani, just as it is often 


